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ABSTRACT 

To assess the impact of the National Academy Foundation (NAF) 
career academy (CA) model, a large-scale, multi-site evaluation was 
undertaken. Survey and interview data on program experiences and 
postsecondary outcomes were analyzed from nine CA programs. The study used 
pre-post evaluation of student data, field visits, and written and telephone 
surveys. It drew on data for 199 graduating CA seniors and a comparison group 
of 190 non- CA seniors; survey data for 157 aliamni who had graduated from 9 
long-standing NAF-af filiated CAs 5 and 10 years before the study; survey data 
for 34 CA and 26 non-CA teachers; and survey data for .192 employees. Findings 
include the following: (1) the program impacts students positively by 

providing a quality experience they find beneficial and by engaging them in 
schooling, but it neither adds to nor detracts from their overall academic 
achievement; (2) as measured by their college enrollment and completion, 
improved career aspirations, and employment outcomes, the program positively 
impacts students* postsecondary transitions; (3) for teachers, the CA model 
challenges them to think differently about their work with students, their 
teaching, and their work with one another; (4) CAs provided a structured 
avenue for strategic and substantive employer participation. (Contains 18 
references) (YLB) 
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Shaping Postsecondary 
Transitions: Influences of 
the National Academy 
Foundation Career 
Academy 

Margaret Terry Orr 
Katherine L Hughes 
Melinda Mechur Karp 

A confluence of educational issues 
and policy developments has brought 
renewed emphasis on efforts to improve 
adolescents* transitions to further educa- 
tion and careers. With raised academic 
expectations for all students and an econ- 
omy that requires a more highly skilled 
labor force, more students are graduating 
from high school and enrolling in college. 
Yet many come under-prepared, flounder, 
and drop out, due in large part to inade- 
quate high school coursework and insuffi- 
cient college preparation (Adelman, 1999). 

Since the National Commission on 
Excellence in Education (1983) called for 
higher academic standards, educators 
have looked for ways to increase high 
school performance levels, particularly 
among those who were not traditionally 
viewed as college-bound. More recently, 
educators have become particularly con- 
cerned with students’ poor engagement 
in their senior year (The National 
Commission on the High School Senior 
Year, 2001). 

The high school has become 
increasingly criticized for its inadequate 
curriculum content, organization, and 
focus (American Youth Policy Forum, 
2000; Education Trust, 2001). Some crit- 
ics have questioned the nature and con- 
tent of teaching — as hindering rather than 
enhancing student learning because of a 
reliance on a narrow range of teaching 
strategies and de-contextualized con- 
tent — and high schools’ limited relation- 
ships with business and Industry. Among 
the strategies thought to facilitate high 
school student learning are small schools 
(Lee & Smith, 1995) and academic cur- 
riculum linked to real-world experiences 
(Resnick, 1987). 

Career academies have consider- 
able potential: they use career planning 
and exposure to increase students’ 
engagement In schooling, while sharpen- 
ing students’ preparation for college and 
careers. The emphasis on academics 



through an integrated and contextualized 
curriculum can improve students’ learn- 
ing, while work-based learning and busi- 
ness involvement enrich and diversify stu- 
dents’ high school experience. The career 
academy’s partial school-within-a-school 
design creates a more intimate learning 
environment. The career academy model 
has spread rapidly over the past 20 years 
and is now being promoted as an integral 
part of many high school reforms 
(McPartland et al., 1998). 

Although there is evidence of its 
impact as a quality high school experi- 
ence (Kemple, 1997; Orr et al., 1987; Orr 
& Fanscali, 1995), limited and somewhat 
contradictory research exists on the 
model’s effectiveness in facilitating qual- 
ity postsecondary transitions. Some 
research has pointed to post-high 
school success (Maxwell, 2001 ; Orr, 
1990; Orr & Fanscali, 1995). However, 
Manpower Demonstration Research 
Corporation’s (MDRC) methodologically 
rigorous random-assignment study of 
nine academies found little impact on 
participants’ high school graduation and 
Initial college-going rates — ^they and 
their comparison group had similar, high 
rates (Kemple & Snipes, 2000). 

One particular model of career 
academy, sponsored by the National 
Academy Foundation (NAF), embodies all 
the key features thought to define a suc- 
cessful career academy — contextualized 
academics and applied coursework, stu- 
dent internships, business and industry 
participation, and an emphasis on college 
and career planning within the industry’s 
field — and therefore may provide better 
postsecondary outcomes than might exist 
for more typical career academies. NAF 
provides curricular support, professional 
development, and technical assistance to 
a national network of high school acade- 
mies of finance, travel and tourism, and 
Information technology. 

Study Methodology 

To assess the Impact of the NAF 
career academy model, a large-scale, 
multi-method, multi-site evaluation was 
undertaken by the Institute on Education 
and the Economy, from spring 2000 
through summer 2001 , at the request of 
NAF. Sun/ey and Interview data on pro- 
gram experiences and postsecondary out- 
comes were compiled from ten^ career 
academy programs. 



The study used a mixed method- 
ology, including pre-post evaluation of 
student data, field visits, and written and 
telephone surveys. The research was lim- 
ited to well-implemented, long-standing 
programs. The study was designed to 
determine whether and to what extent 
career academies shape students’ expe- 
riences while in high school and facilitate 
their transitions to college and careers. 
The researchers also wanted to see how 
the program’s philosophy, design, and 
operations yielded benefits for teachers 
and participating employers. 

The study drew on survey and 
transcript data for 199 graduating career 
academy seniors and a comparison 
group of 190 graduating non-academy 
seniors; survey data for 157 alumni who 
had graduated from nine long-standing 
NAF-affiliated career academies five and 
ten years before the study began; sur- 
vey data for 34 academy teachers and 
26 non-academy teachers; and survey 
data for 192 employers. 

The study used comparison groups 
selected from the same schools and 
among seniors who were not affiliated 
with career-focused programs or other 
specialized academic programs. 
Statistical analysis of the academy and 
comparison seniors showed that, among 
personal demographics and risk factors 
commonly associated with educational 
outcomes, the two samples differed only 
on the measure of parents’ educational 
attainment, with the academy students’ 
parents having slightly more education. 
Analysis of the two groups’ GPAs at the 
time of enrollment found that on this 
measure the academy students were 
slightly advantaged as well. There was 
no difference In the two samples’ atten- 
dance rates. The academy sample was 
only somewhat more likely to be Inter- 
ested in the career field or In a better 
educational experience. The two teacher 
groups had similar demographic and 
teaching characteristics, although the 
academy teachers were somewhat more 
likely to be male and nonwhite than 
were the non-academy teachers. 

The Career Academy as a 
Learning Experience 

To enroll students in NAF career 
academies, program staff actively recruit 
students from their classes, encouraging 
those who might need a “hook” to stay in 
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school or who could benefit from a 
career-focused program of study, but 
who are not necessarily college-bound. 

Most students at NAF-supported 
career academies have four or more core 
academy courses during their junior and 
senior years, a computer or technology 
course, a paid six-week summer Intern- 
ship with a private company, a college- 
level course, and a variety of industry 
exposure and college and career plan- 
ning activities. In contrast, few compari- 
son seniors had such experiences, 
except for computer technology courses. 

The internship, the program’s cor- 
nerstone, is typically six to eight weeks of 
paid summer work in a private industry- 
affiliated company. Sixty-five percent of 
the academy seniors (and 84 percent of 
the alumni) had a paid, program-related 
summer internship, while only 8 percent 
of comparison seniors did. Typically the 
career academy internships were of high 
quality, with several attributes that distin- 
guish them from typical after-school 
work: most NAF career academy stu- 
dents spent some time in training at their 
internship, were supervised by school 
staff, had a designated work site supervi- 
sor and, for many, a workplace mentor. 

Academy seniors also had a variety 
of work-based learning experiences and 
co-curricular activities to help them learn 
about the industry, explore careers, plan 
for college, and develop their social and 
interpersonal skills. They were much 
more likely than the comparison seniors 
to talk about colleges in class, learn 
about financial aid, and visit colleges. 
Academy seniors were significantly more 
likely than other seniors to plan for work 
after high school, to secure a job offer by 
graduation, and much more likely to par- 
ticipate in career exploration activities, 
job fairs, mentoring relationships, and 
practice interviews. 

How the Career Academy Program 

Impacts Students in School 

The research found that the pro- 
gram impacts students positively by pro- 
viding a quality experience that they find 
beneficial and by engaging them in 
schooling, but it neither adds to nor 
detracts from their overall academic 
achievement. 

First, academy seniors rated their 
courses significantly higher than did other 
seniors for contextualizing the subject 



matter, supporting student learning, incor- 
porating college and career planning, and 
being more interesting than other acade- 
mic classes. 

Second, the majority of academy 
seniors rated their academy experience 
as highly beneficial academically and in 
planning for careers. Consequently, 
most academy seniors felt that they 
were more prepared for their future than 
their non-academy friends because of 
these experiences. Most alumni report- 
ed similar assessments, crediting the 
program for improving their workplace 
and other interpersonal skills and moti- 
vating them academically. 

Third, the academy seniors and 
alumni agreed that their academy experi- 
ence influenced their career plans: for 
seniors, it helped them prepare for a 
career in the field (82 percent), caused 
them to seek a challenging career path 
(75 percent), and generally interested 
them in a career in the field (69 percent). 
Most alumni (90 percent) agreed that their 
career academy experience helped them 
develop their career plans in the academy 
field or a related area. For many, the 
academy experience was a pivotal influ- 
ence on their career direction. 

Fourth, the program fostered a sup- 
portive learning environment for students 
through its school-within-a-school organi- 
zation and thematic focus. Academy 
seniors were more likely than other 
seniors to feel motivated by and engaged 
in schooling, and improved their school 
attendance more during high school than 
did other seniors. 

Academy seniors had better initial 
GPAs than did the comparison seniors 
and did not change this average signifi- 
cantly by their senior year, despite the 
possible distraction of the work experi- 
ence and demanding college course. 

The Impact of the Career Academies 
on Transitions to College and 
Careers 

As measured by their college 
enrollment, completion, improved career 
aspirations, and employment outcomes, 
the program positively impacted stu- 
dents* postsecondary transitions. 
Academy seniors took several measures 
to prepare for college, and significantly 
more so than comparison seniors, such 
as completing at least one college-level 
course and engaging in college planning 



actions. By the time they were graduat- 
ing, 77 percent of the academy seniors 
and 64 percent of the comparison 
seniors planned to go to college after 
high school and had already been 
accepted. 

Even when we took into account 
factors such as gender, race, geographic 
mobility, parents’ educational attainment, 
advanced academic high school course 
taking, and initial GPA for the academy 
and non-academy groups, we found that 
the academy affiliation independently 
influenced whether students had 
planned for and been accepted into a 
four-year college. Much of this is attrib- 
utable to the Finance Academy seniors, 
however, since Travel and Tourism 
Academy seniors were as likely as the 
comparison seniors to be planning to 
work or enroll in a two-year college. 

Many program alumni followed 
through on these positive starts by com- 
pleting a two-year or four-year college 
degree within five to ten years. Fifty-two 
percent of the ten-year alumni and 44 
percent of the five-year alumni had com- 
pleted a four-year degree. Forty-five 
percent of those with degrees (either 
two-year or four-year) had earned them 
in fields related to their academy indus- 
try. Moreover, while 20 percent of all 
first-time college goers reported needing 
remedial coursework (National Center 
for Education Statistics, 1998), only 8 
percent of the academy alumni did. 

Finally, the academy experience 
positively influenced the participants* 
employment aspirations and outcomes. 
The career academy seniors* Interest In 
the academy industries increased signif- 
icantly during their program years, par- 
ticularly for travel and tourism seniors. 
Only some career academy seniors had 
been interested in their academy*s 
Industries when they started, but by the 
time they graduated, the percentage 
interested had doubled. The majority of 
graduating academy seniors planned to 
combine work and college after high 
school graduation, and most alumni 
had. Twenty-six percent of the graduat- 
ing seniors had plans to work for their 
internship employer or other academy- 
affiliated employer in the summer or fall 
after high school. 

Most working alumni appeared to 
be In career-track positions five and ten 
years after graduating. Eighty-five per- 



3 



cent were working and most were in a 
professional field. Most of the alumni 
were satisfied with their current job 
based on a wide range of job satisfaction 
characteristics, including its field, the 
nature of the work, pay, benefits, impor- 
tance, challenge, security, permanence, 
and opportunities for advancement. 

Many alumni were working some- 
what or directly in their academy-affiliat- 
ed field, and 8 percent of working alum- 
ni were still with their original internship 
employer or one that was academy- 
affiliated. 

How the Program Benefits Teachers 

For teachers, the career academy 
model challenges them to think differently 
about their work with students, their 
teaching, and their work with one anoth- 
er. NAF sponsors a national professional 
development conference, provides con- 
textualized curriculum, and facilitates 
local business affiliation to engage teach- 
ers in the underlying ideas and philoso- 
phy of the academy approach. The con- 
ference exposes teachers to new ideas 
and practices from other settings, con- 
nects them with teachers from other 
schools, and engages them in non- 
school-based learning experiences. The 
program's thematic focus, cohort struc- 
ture, and partial school-within-a-school 
organization encourage teacher collabo- 
ration, making it a more supportive work 
environment. 

According to survey information, 
the career academy teachers have been 
with their academy for several years. In 
six sites, the teachers taught part-time 
in the program; in the other three sites, 
they were exclusively with the program. 
Almost all were committed to the acade- 
my philosophy and approach, but only 
some relied on the NAF curriculum 
almost exclusively in their academy 
courses. Most reported using an applied 
curriculum approach, project-based 
instruction, and career exploration activ- 
ities In their academy classes, as recom- 
mended by NAF. Most believed that 
they created a supportive learning envi- 
ronment for their students and for one 
another. 

About half the teachers met 
together at least monthly, often focusing 
on instructional strategies and individual 
students. The majority of teachers had 
attended at least one NAF conference in 



the last ten years, and almost all who 
attended agreed these were effective. 

For some, these conferences were inte- 
gral to their teaching — by motivating, 
inspiring, and building a network. The 
majority of teachers reported using 
some business support, through consul- 
tation, advice, and training. 

By working with a small group of 
students — ^whom they often taught sev- 
eral times — ^teachers developed more 
supportive relationships with them, rein- 
forcing their commitment to the pro- 
gram, and enhancing their satisfaction in 
teaching. 

How the Program Benefits 
Employers 

Career academies, particularly 
those affiliated with NAF, also provide a 
structured avenue for strategic and sub- 
stantive employer participation. Even 
with the stress on employer participation 
in schools through the School-to-Work 
Opportunities Act, there has been skep- 
ticism over the potential for widespread 
employer involvement in high school 
programs. Some researchers (Bailey, 
1995) have argued that it would be diffi- 
cult to sustain large-scale employer par- 
ticipation simply for philanthropic rea- 
sons. Our research suggests that inter- 
mediary organizations, such as NAF, 
can facilitate schools’ relationships with 
employers. 

NAF encourages its local program 
affiliates to recruit businesses for pro- 
gram advisory boards, which in turn can 
facilitate internships, career exploration 
activities, teacher professional develop- 
ment, and other kinds of instructional 
support. According to employer inter- 
views, the nine long-standing programs 
that we studied have attracted well- 
established private sector firms within 
their respective industries, while intern- 
ship programs generally rely on nonprof- 
it and governmental placements (Bailey, 
Hughes, & Barr, 2000). 

These employers — at the nine 
long-standing programs— created quali- 
ty internships in their firms and else- 
where, provided direct and Indirect 
financial assistance, advised on curricu- 
lum, and advocated for the program 
with the school district. The employers 
averaged five interns per summer — 
which contrasted sharply to more typical 
work-based learning programs In which 



employers usually averaged one or two 
interns at a time (Lynn & Wills, 1994) — 
and offered good wages, averaging 30 
percent more than minimum wage. Most 
enhanced the internship experience with 
mentoring, opportunities to learn about 
the industry, and job rotations, creating 
a higher quality experience than is typi- 
cal (Kemple & Snipes, 2000). 

Most employers reported that they 
were initially motivated primarily by a 
desire to contribute to education and 
the community. But the strongest incen- 
tive for their continued participation 
seems to be the quality and effective- 
ness of the interns. Employers rated the 
interns’ skills as equal to or better than 
their entry-level employees. For some 
employers, the program has become a 
pipeline for quality employees, with half 
reporting that they have offered stu- 
dents permanent positions right after 
high school. Finally, almost all agreed 
that their commitment would remain 
strong in the future, and that they plan 
to continue as internship sponsors. 

Conclusions 

From the various debates in recent 
years about high schools, three con- 
verging objectives for transitioning ado- 
lescents have emerged: Improve their 
academic skills and performance, 
increase college-going and college com- 
pletion, and shorten the floundering 
period between high school completion 
and quality employment. Many high 
school reform recommendations under- 
score features that are typical for career 
academies, particularly the NAF-sup- 
ported ones: creating a small, more Inti- 
mate learning community; using themat- 
ic, contextualized, and challenging cur- 
riculum; incorporating student-centered 
Instructional practices; and engaging 
learning resources from businesses and 
the community at large. 

Until now, limited evidence existed 
on whether these features. If Implement- 
ed well, actually yielded the hoped-for 
outcomes of improved student transi- 
tions into and through college and Into 
quality employment. The evidence 
shown here clearly demonstrates that 
the NAF-afflllated career academies cre- 
ated a distinguishable experience for 
participating students. The evidence 
from this study also demonstrates the 
value of sustaining an enriched high 
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school experience that encompasses 
the workplace as well as the school, is 
supportive for both students and teach- 
ers, and provides a challenging, themat- 
ic focus for both teaching and student 
learning. 

The NAF-affiliated academies serve 
a cross-section of student abilities and 
interests. They encourage all students to 
be well prepared for college and devel- 
op a strong interest in a career field. 
These academies improved students’ 
engagement in school and their ability to 
be successful in college and move into 
quality employment. The strongest 
results were from the alumni’s current 
employment, which for most was of high 
quality, fitted well with their long-range 
career goals, and, for many, was in a 
field that related directly or indirectly to 
their academy’s industiy. 

NAF’s organizational structure 
seems to contribute significantly to 
overall model fidelity in the local sites, 
and to successful employer involvement 
and quality teacher preparation. NAF 
personnel guide local program staff in 
their recruitment of and relationships 
with local employers. For teachers, NAF 
provides structured ways to engage with 
other teachers in improving their teach- 
ing craft, focusing their work, and infus- 
ing college and career preparation in 
their work with high school students. 
NAF’s emphasis on the core program 
features and on employer and teacher 
resources seems to encourage sus- 
tained program quality, which in turn 
contributes to students’ success. 

While positive, these outcomes 
must be interpreted cautiously. The 
study is only of program completers, 
and the comparison group was not ran- 
domly selected but chosen as average 
seniors without a career-program expe- 
rience. Comparisons of academy and 
other seniors showed them to be similar 
on most demographic and risk factors, 
but the academy seniors had slightly 
better GPAs when enrolling in the acad- 
emy than their comparisons. Thus, some 
positive results may be due to these ini- 
tial differences or other unaccounted-for 
factors. Nonetheless, this research 
shows that the career academy is a 
viable educational experience that 
Improves students’ engagement in high 
school and facilitates effective transition 
to further education and careers. 
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